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PREFACE 


This  report  documents  the  results  of  USAFETAC  Project  900807,  as  performed  by 
USAFETAC’s  Operations  Applications  Development  Section  (DNO).  The  DNO  analyst  was 
William  R.  Schaub,  Jr. 

The  tasking,  from  Detachment  13,  20th  Weather  Squadron  (amended  by  20WS/DO),  asked 
USAFETAC  to  develop  statistically  significant  thresholds  of  1 1  atmospheric  variables  that  could 
be  used  for  forecasting  snow  at  Misawa  AB,  Japan.  The  1 1  variables  were  gradient-level 
temperature  and  dew-point  temperature,  850-mb  temperature,  700-mb  temperature,  thicknesses 
for  five  layers  between  1,000  feet  AGL  and  500  mb,  gradient  wind  direction,  and  gradient  wind 
speed. 

DNO  started  by  making  simple  correlations  of  each  variable  with  observed  6-hour  snowfall 
amounts  to  develop  a  linear  regression  equation  for  predicting  6-hourly  snowfall  amounts.  When 
the  linear  regression  did  not  show  skill,  the  study  was  expanded  to  produce  a  decision  tree  for 
making  a  "yes"  or  "no"  snow  determination.  The  decision  tree  scored  well  using  dependent  data, 
but  not  very  well  on  independent  data;  in  fact,  it  lost  to  persistence. 

USAFETAC  does  not  recommend  either  technique  for  use  in  operational  forecasting,  but 
suggests  that  the  decision  tree  be  developed  further  and  evaluated  with  a  longer  period  of  record. 
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1.  INTRODUCTION. 

1.1  Background.  During  the  Siberian  northwest  monsoon,  there  is  frequent  and  heavy 
snowfall  in  the  western  coastal  regions  of  central  Japan  on  the  island  of  Honshu.  These  coastal 
regions  are  windward  of  a  mountain  range  that  extends  the  full  length  of  the  island.  As  cold  air 
masses  move  over  the  warm  Sea  of  Japan,  heat  and  moisture  transfer  results  in  extensive 
cloudiness.  The  resultant  snowfall  along  the  west  coast  of  Honshu  has  been  attributed  primarily 
to  orographic  lifting  (Estoque  and  Ninomiya,  1976),  a  precipitation  mechanism  that  contrasts 
with  the  lake-effect  snows  in  the  Great  Lakes  region  of  the  United  States.  In  the  absence  of 
orography,  mesoscale  convective  %y  stems  develop  on  the  leeward  side  of  the  Great  Lakes  and 
produce  heavy  snowfall  in  western  and  central  New  York  (Niziol,  1987). 

1.2  FOCUS  Of  the  study.  This  study  concerns  Misawa  Air  Base,  Japan  (40°  2'  N,  141°  22' 
E),  situated  near  the  northeast  comer  of  Honshu  on  the  leeward  side  of  the  mountains  (see 
Figure  I).  Misawa  averages  more  than  120  inches  of  snow  a  year.  The  customer  for  this  study 
(Detachment  13,  20th  Weather  Squadron)  uses  several  tools  for  snow  forecasting;  these  include 
local  forecast  studies,  analysis  of  the  Misawa  upper-air  sounding,  and  model-derived  forecasts  of 
surface  and  upper-air  variables. 
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1.3  Atmospheric  Variables  Used.  Detachment  13  provided  USAFETAC  with  11  basic 
atmospheric  variables.  These  were  collected  over  one  winter  season  and  part  of  another  from 
forecast  bulletins  issued  twice  daily  by  the  Air  Force  Global  Weather  Central  (AFGWC).  The 
amount  of  data  supplied  was  the  minimum  necessary  to  attempt  a  study.  Det  13  asked 
USAFETAC  to  perform  a  statistical  analysis  of  the  1 1  variables  supplied  to  see  if  any  value  of 
any  variable  could  be  related  to  the  amount  of  observed  6-hour  snowfall.  "Basic," 
"time-phased,"  and  "trend”  variables  are  shown  and  explained  below. 


Basic  Variables1 


GRADDEWT 

TEMP850 

TEMP700 

THKNS1 

THKNS2 

THKNS3 

THKNS4 

THKNS5 

GRWNDDIR 

GRWNDSPD 


Definitions 

Gradient-level  temperature  over  Misawa. 
Gradient-level  dew  point  temperature  over  Misawa. 
Temperature  at  850  mb  over  Misawa. 

Temperature  at  700  mb  over  Misawa. 

Thickness  from  1 ,000  ft  AGL  (above  ground  level) 
to  500  mb  over  Misawa. 

Thickness  from  1 ,000  ft  AGL  to  700  mb  over  Misawa. 
Thickness  from  1,000  ft  AGL  to  850  mb  over  Misawa. 
Thickness  from  850  mb  to  500  mb  over  Misawa. 
Thickness  from  850  mb  to  700  mb  over  Misawa. 
Gradient  wind  direction  over  Misawa. 

Gradient  wind  speed  over  Misawa. 


Til 


Variables 


GRADDEW 

TEMP85 

TEMP70' 

Trend  Variables3 


GRDDDIFF 

T850DIFF 

T700DIFF 


THKNS1 

THKNS5 

THKNS2* 

gwnddFr 

THKNS3" 

THKNS4" 

GWNDSPP 

THK1DIFF 

THK5D1FF 

THK2DIFF 

WD1RD1FF 

THK3D1FF 

THK4D1FF 

'  VSPDDIFF 

7  Variables  valid  at  lime  of  snowfall  measurement 

2  Same  as  basic  varialAcs,  but  valid  6  hours  prior  to  snowfall  measurement 

3  Changes  in  basic  variables  during  the  6  hours  prior  to  snowfall  measurement 


Figure  2.  List  of  VcAables.  Units:  temperatures  in  Celsius  (C),  thicknesses  in  gocnotential 
meters,  gradient  wind  directions  in  degrees,  and  gradient  wind  speed  in  knots. 
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1.4  Correlations  Requested.  Threshold  values  for  each  of  the  11  basic  variables  were 
requested  for  forecasting  6-hour  snowfall  amount.  Det  13  recommended  the  following 
correlations  with  6-hour  observed  snowfall: 

•basic  variables- those  with  the  same  valid  time  (OOOOZ  plus  ever)'  6  hours)  as  snowfall 
measurement. 

•time-phased  variables-those  with  valid  times  6  hours  prior  to  each  snowfall 
measurement. 

•trend  variaWes-the  changes  in  variables  during  the  6  hours  prior  to  each  snowfall 
measurement. 

1.5  The  Correlation  Scheme.  DNO  used  the  pairing  scheme  shown  in  Figure  3  to  compute 
the  requested  correlations  by  the  Pearson  product-moment  correlation  method.  Although  the 
correlations  shown  below  were  low,  linear  regression  was  attempted  on  the  basic  and 
time-phased  variables  (the  predictors)  to  develop  predictive  equations  for  6-hour  snowfall 
amount  in  inches  (the  predictand).  All  attempts  at  regression,  using  the  statistically  best 
combinations  of  variables,  resulted  in  snowfall  estimates  far  below  the  amounts  actually 
observed;  the  results  are  not  presented.  Had  more  variables  been  available  (e.g„  moisture  and 
winds  at  upper  levels),  results  may  have  been  more  encouraging,  fshihura  (1968)  was  successful 
in  obtaining  realistic  predictions  of  average  daily  snowfall  in  35  areas  of  the  Hokuriku  District  of 
west  central  Honshu.  With  much  more  surface  and  upper  air  data  at  his  disposal,  Ishihara  was 
able  to  include  water  vapor  transport,  instability  energy,  winds  aloft,  relative  vorticity, 
divergence,  and  vertical  motion  as  predictors  in  the  linear  regression. 


Valid  time 

of  Bulletin-  Snowfall 

Forecasted  Variables  Measurement  Time  Variable  Trends 


OOOOZ 

0600Z 

1200Z 

1800Z 

OOOOZ 


correlate 

correlate 

correlate 

correlate 


♦-0600Z 
►  1200Z 
1800Z 
■*-(XXX)Z 


correlate - (XXX)-06(50Z 

correlate - 06<X)- 1 2(X)Z 

correlate - 1 200- 1 8(X)Z 

correlate - 1 800-(XXX)Z 


Figure  3.  Correlation  Scheme.  Variables  and  variable  trends  are  correlated  with  6-hour 
observed  snowfall  amounts,  as  shown  by  arrows. 
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1.6  Th©  Snow  Forecasting  Decision  Tree.  After  confirming  the  unfavorable  correlation 
and  regression  results,  USAFETAC  used  knowledge  gained  from  a  study  on  lake-effect  snow  at 
Griffiss  AFB,  New  York  (De  Block  and  Schaub,  1990)  to  develop  a  snow  forecasting  decision 
tree  for  Misawa.  This  decision  tree  (shown  in  Figure  4)  includes  all  the  basic  variables  provided 
by  the  customer  except  gradient-level  dew  point  temperature.  In  order  to  use  the  decision  tree  to 
determine  whether  snow  is  likely,  all  the  threshold  values  of  the  variables  must  be  met.  Of  many 
trees  tested,  this  one  verified  best  and  showed  the  most  forecasting  skill— see  Section  4  for  a 
comparison  of  forecast  skill  between  the  decision  tree,  the  snow  forecasts  issued  by  Misawa,  an 
objective  snow  amount  estimation  technique  used  at  Misawa,  and  persistence.  USAFETAC 
believes  that  snow  forecasting  at  Misawa  can  be  improved  by  using  the  tree,  but  this  study 
provides  only  initial  guidance  in  developing  a  forecast  aid;  it  is  not  an  approved  forecast  study. 
As  more  data  is  gathered,  the  actual  thresholds  used  in  this  study  may  change  significantly. 
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DECISION  TREE  FOR  SNOW  AT  MISAWA  AB,  JAPAN 


NO 


IS  THE  forecast  gradient-level  temperature  (GRADTEMP)  ^  -1&C? 


NO 


NO 


NO 


NO 


N 


YES 


♦ 


Figure  4.  Snow  Forecasting  Decision  Tree  tor  Use  as  a  Guide  at  Mtsawa  Air  Base,  Japan. 
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2.  DATA  AND  LIMITATIONS. 


2.1  Variable  Data  Provided.  Det  13  provided  the  !  I  basic  variables  shown  in  Figure  2  for 
these  periods  of  record:  1 1  January  1989  to  27  February  1989,  and  23  October  1989  to  16  March 
1990.  Data  was  collected  from  forecast  bulletins  FJAS  KGWC  and  FXPA  40  KGWC,  issued 
daily  at  OOOOZ  and  1200Z  by  the  Air  Force  Global  Weather  Central  (AFGWC).  FJAS  KGWC  is 
based  on  the  AFGWC  Macroscale  Cloud  Model:  it  provides  gradient-level  temperature  and  dew 
point  temperature,  850-mb  temperature,  and  700-mb  temperature  for  Misawa  valid  every  6  hours 
for  48  hours  from  issue  time.  FXPA  40  KGWC  is  based  on  the  AFGWC  Asian  Boundary  Layer 
Model,  the  AFGWC  Macroscale  Cloud  Model,  and  the  coarse  mesh  grid  system  data  (from 
Global  Spectral  Model);  it  provides  gradient-level  wind  direction  and  speed,  as  well  as  thickness 
for  five  layers,  valid  every  6  hours  for  36  hours  from  issue  time.  To  develop  the  Misawa  snow 
forecasting  decision  trees,  the  data  from  23  October  1989  to  16  March  1990  was  used.  For 
independent  verification  of  the  trees,  only  6  weeks  of  data  (11  January  1989  to  27  February 
1989)  was  used. 

222  Actual  Snow  Data  Provided.  Along  with  the  basic  variables,  Det  13  also  provided  data 
on  actual  6-hour  snow  amount  forecasts  and  6-hour  snow  amount  estimates  made  as  a  Misawa 
forecasting  guide  following  objective  procedures  recommended  by  Cook  (1980).  The  actual 
6-hour  snow  amount  forecasts  are  included  in  Misawa  forecasts  issued  every  6  hours  and  valid 
for  24  hours.  To  obtain  snow  amount  estimates  from  Cook's  method,  the  300- mb  analysis  is 
used.  The  warmest  temperature  found  within  15  degrees  of  latitude  upstream  from  Misawa  is 
subtracted  from  the  3(X)-inb  temperature  over  Misawa.  The  absolute  value  of  that  difference  is 
divided  by  two  and  used  as  the  estimated  snowfall  in  inches  for  a  24-hour  period.  The  estimate 
is  reduced  by  half  if  there  is  cold  air  advection  at  700  mb  within  8  degrees  of  latitude  upstream 
from  Misawa.  The  estimated  24-hour  snowfall  amount  is  then  divided  by  four  to  obtain  6  hour 
snow  amount  estimates.  Finally,  the  data  on  Misawa’s  6-hour  snow  amount  forecasts,  and 
estimates  from  Cook's  method,  were  verified  against  observed  snowfall:  this  is  described  in 
Section  3. 

2.3  Period  Of  Record  (POR)  Limitations.  An  obvious  limitation  on  the  results  of  this  study 
was  the  short  POR  that  included  only  one  full  winter  season  and  part  of  another.  As  shown  by 
Rodney  (1986),  a  POR  near  10  years  is  considered  adequate  to  provide  a  stable  arithmetic  mean 
of  a  variable.  With  the  arithmetic  mean  stable,  a  variable  has  a  relatively  low  error  of  prediction. 
This  is  important  in  regression  analysis,  where  a  variable  is  used  as  a  predictor.  A  longer  POR 
may  have  improved  the  results  of  this  study  and  resulted  in  a  significantly  ditferent  decision  tree. 

2.4  Data  Limitations.  Although  there  were  enough  basic  variables  to  allow  development  of  a 
useful  snow  forecasting  decision  tree,  there  was  not  enough  information  for  development  of  a 
regression  equation  to  predict  6-hour  snuwfaii  amount.  Isiiihara  0968)  noted  the  importance  of 
the  850-mb  dew  point  depression  as  a  predictor  for  snow  accumulation.  He  also  noted  that  the 
500-mb  temperature  is  important  because  of  its  relationship  with  instability  and  the 
mid-tropospheric  cold  low  over  the  Sea  of  Japan  in  winter.  Nagata  ( 1987)  used  a  24-year  period 
of  record  for  January  to  show  the  importance  of  upper-level  winds  as  related  to  daily  snowfall 
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amounts  in  western  coastal  areas  of  Honshu.  For  the  Tohoku  District  of  Honshu,  where  Misawa 
Air  Base  is  located,  Nagata  found  a  positive  correlation  (correlation  coefficient  0.392)  between 
winds  aloft  and  daily  snowfall.  The  positive  correlation  occurred  when  winds  at  Akita  were 
southeasterly  up  to  600  mb,  with  speed  increasing  with  height.  In  the  study  by  De  Block  and 
Schaub  (1990),  dew  point  depression  at  850  mb  and  upper  winds  to  700  mb  were  essential 
ingredients  for  development  of  lake-effect  snow  forecasting  decision  trees.  From  these 
examples,  one  can  see  that  upper-level  moisture  and  wind  information  would  have  been  helpful 
in  this  study. 
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3.  METHODOLOGY. 


3.1  Approach.  As  the  customer  requested,  the  correlation  scheme  shown  in  Figure  3  was  used 
to  correlate  all  1 1  input  variables  with  6-hc  .  observed  snowfall.  An  effort  was  also  made  to 
obtain  a  predictive  equation  for  6-hour  snowfall  amount  (the  predictand)  through  linear 
regression  on  the  basic  and  time-phased  variables  (the  predictors).  The  second  part  of  this 
approach,  which  went  beyond  Det  13’s  original  request,  resulted  in  development  (from  basic 
variables)  of  a  decision  tree  for  use  as  a  snow  forecasting  guide. 

3.2  Procedure.  Data  from  both  PORs  were  combined  into  one  data  set.  Before  analysis,  plots 
of  observed  6-hour  snowfall  (including  zero)  versus  each  basic  variable  were  made  to  examine 
the  appearance  of  the  distributions  and  evaluate  any  outliers.  Some  erroneous  data  was  detected 
and  corrected.  For  development  of  the  snow  forecasting  decision  tree,  observations  were  sorted 
according  to  snow  (trace  or  more)  or  no-snow  cases.  In  that  way,  distributions  of  the  variables 
could  be  analyzed  for  both  cases. 


3.3  Correlations.  Correlations  were  done  between  all  1 1  basic  variables  and  observed  6-hour 
snowfall  amounts  to  determine  the  degree  of  linear  relationship.  A  summary  of  correlation 
results  is  shown  in  Figure  5. 


"Basic 

Correlation 

Time-Phased 

Correlation 

Trend 

Correlation 

Variates 

Coefficients 

Variables 

Coefficients 

Variables 

Coefficients 

GP.AuTEMP 

-0.253 

GRADTEM 

-0.227 

GRDTDIFF 

-0.082 

r-  ADDEVvT 

-0.226 

GRADDEW' 

-0.199 

GRDDDIFF 

-0.069 

T:  /  '850 

-0.242 

TEMP85 

-0.224 

T850DIFF 

-0.053 

.  :P700 

-0.217 

TEMP70' 

•0.217 

T700DIFF 

0.006 

THKNSI 

-0.247 

THKNSf 

-0.233 

THKID1FF 

-0.05.3 

THKNS2 

-0.251 

THKNS2" 

-0.231 

THK2DIFF 

-0.04! 

THKNS3 

-0.273 

THKNS3" 

-0.240 

THK3DIFF 

-0.102 

THKNS4 

-0.190 

THKNS4 

-0.183 

THK4DIFF 

-0.(K!7 

THKNS5 

-0.244 

THKNS5 

•0.234 

THK5D1FF 

-0.0.30 

GRWNDDIR 

0.039 

GWNDDIR 

0.015 

WDIRDIFF 

0.025 

GRWNDSPD 

tr39 

gwndspd" 

0.169 

WSPDDIFF 

0.105 

*  Variable  definitions  and  mils  of  tncasi  'e: 


GRADTEMP 

GRADDEWT 

TEMP850 

TEMP700 

THKNSI 

THKNS2 

THKNS3 

THKNS4 

THKNSi 

GRWNDDIR 

GRWNDSPD 


Gradient-level  tempt ovv  Mis  aw;.  ("C). 

Gradient-level  dcw-pei.i!  *  :mpt rat-  re  over  Misawa  (°C). 

Tctnpcralu.e  at .'  7)  mb  over  Misawi  ("C> 

Temper 'tlur  at  700  mb  over  Misawa  C'C). 

Thickness  1,00(1  ft  AG l,  (above  ground  level)  5(H)  mb  over  Misawa  (gcopotential  meters). 
Thickness  1,000  ft  AG  L  750  mb  over  Misawa  (gcopotential  meters). 

Thickness  1,000  ft  AGL-850  mb  over  Misawa  (geopotcmial  meters). 

Thickness  850-500  mb  over  Misawa  (geopolentiul  meters). 

Thickness  351,-700  mb  over  Misawa  (gcopotential  meters). 

Gradient  wind  direction  ovet  Misawa  (degrees). 

Gradient  w  speed  over  Misawa  (knots). 


Figure  5.  CorreluLons  oj  Model-Derived  Atmospheric  Variables  with  Observed  6-hour 
Snowfall  Amounts  (including  zero  and  trace )  for  Misawa  Air  Base ,  Japan. 
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A  variable  and  snowfall  amount  are  linearly  independent  (no  predictive  relationship)  if  the 
correlation  coefficient  is  zero,  while  a  correlation  coefficient  of  -1  or  1  indicates  total 
dependence.  With  a  positive  correlation  coefficient,  an  increase  in  magnitude  of  the  variable  is 
accompanied  by  an  increase  in  magnitude  of  snowfall  amount.  In  the  case  of  a  negative 
correlation  coefficient,  an  increase  in  magnitude  of  the  variable  is  accompanied  by  a  decrease  in 
magnitude  of  snowfall  amount.  A  best-fit  straight  line  through  plots  of  snowfall  amount  versus 
variable  has  a  positive  or  negative  slope,  respectively.  None  of  the  variables  showed 
particularly  high  degrees  of  linear  relationship  with  snowfall  amount.  As  pointed  out  by 
Essenwanger  (1986),  low  correlations  may  be  due  in  part  to  a  nonlinear  relationship  between  the 
variables  and  snowfall  amount. 

3.4  Linear  Regression.  Although  correlation  results  were  not  encouraging,  attempts  were 
made  to  develop  a  predictive  equation  for  6-hour  snowfall  amount  by  linear  regression. 
Regression  was  performed  with  each  of  the  basic  variables  separately,  combinations  of  the 
statistically  best  basic  variables,  and  combinations  of  the  statistically  best  basic  and  time-phased 
variables.  Trend  variables  were  not  included  as  predictors  because  of  their  low  correlation 
results.  The  coefficient  of  determination,  R2  (where  1 .0  is  a  perfect  regression  and  0.0  shows  no 
relationship),  did  not  exceed  0.13.  A  coefficient  of  determination  of  0. 1 3  indicates  the  predictors 
could  account  for  only  13  percent  of  the  variability  in  snowfall.  In  all  cases,  observed  6-hour 
snowfall  amounts  were  vastly  underestimated.  For  these  reasons,  regression  results  are  not 
presented. 

3.5  Decision  Tree  Development.  After  the  linear  regression  requested  by  Det  13  did  not 
show  skill,  an  attempt  was  made  to  provide  a  "yes  or  no"  snow  forecast.  Techniques  from  a 
previous  study  (De  Block  and  Schaub,  1990)  were  used  to  develop  the  snow  forecasting  decision 
tree  shown  in  Figure  4.  The  decision  tree  provides  a  "yes  or  no"  determination  of  snow 
occurrence  based  on  10  of  the  forecasted  basic  variables.  When  the  variables  meet  the  threshold 
values  shown,  snow  is  likely  to  occur;  otherwise,  snow  is  unlikely.  As  a  starting  point,  plots  of 
observed  6-hour  snowfall  amounts  (including  zero)  versus  each  basic  variable  were  made  to  see 
the  ranges  within  which  most  of  the  snow  cases  occurred.  Observations  were  then  sorted 
according  to  "snow"  (trace  or  more)  or  "no-snow"  cases,  and  frequency  distributions  of  the  basic 
variables  were  produced  for  each  case  separately. 

3.5.1  If  snow  only  occurred  when  the  gradient-level  temperature  was  less  than  -1°  C,  and  if  it 
never  occurred  when  the  temperature  was  greater  than  -1°  C,  determining  the  threshold  for  the 
decision  tree  would  be  easy.  Unfortunately,  data  showed  that  snow  and  no-snow  cases  both 
occurred  at  -1°  C.  A  subjective  statistical  method  was  then  employed  to  select  the  value 
(threshold)  that  produced  snow  more  times  than  no  snow;  this  involved  using  the  highest 
possible  percentile  value  from  the  temperature  distribution  for  snow  cases  without  exceeding  the 
50th  percentile  temperature  for  no-snow  cases.  As  it  turned  out,  the  95th  percentile  value  for 
snow  cases  was  the  highest  possible  value.  As  shown  in  Figure  6,  if  the  variable’s  95th 
percentile  value  for  the  snow  cases  appeared  at  or  below  the  5()th  percentile  value  for  no-snow 
cases  (if  it  were  associated  with  less  than  half  of  the  no-snow  cases),  it  was  selected  for  use  in  the 
developmental  decision  trees.  This  selection  process  yielded  threshold  values  for  each  basic 
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variable  except  gradient-level  dew  point  temperature,  which  was  excluded  because  its  95th 
percentile  for  snow  cases  was  above  its  50th  percentile  value  for  no-snow  cases  (-3°  C  and  -6°  C, 
respectively).  For  gradient  wind  direction  and  speed,  it  proved  best  to  determine  an  optimum 
range  of  gradient  wind  direction  for  snow  occurrence  and  a  minimum  speed  above  which  snow 
might  occur.  That  determination  was  made  by  analyzing  the  plots  of  6-hour  snowfall  amounts 
versus  those  variables,  and  by  experimenting  with  different  ranges  in  the  decision  trees. 


OBSERVATION 

COUNT 


Figure  6.  Superimposed  Frequency  Distributions  of  a  Variable  for  Snow  Cases  (solid  curve) 
and  No-Snow  Cases  ( dashed  curve).  Point  A  represents  the  50th  percentile  for  no-snow  cases; 
Point  B  represents  the  95th  percentile  for  snow  cases.  In  this  example,  the  value  at  B  would  be 
used  as  a  threshold  in  the  decision  tree.  If  the  value  of  the  variable  were  less  than  or  equal  to  B, 
snow  was  likely. 

3.6  Verification  Statistics.  To  develop  the  final  tree,  the  variables  used  (and  their 
thresholds)  were  varied.  A  Heidke  skill  score  (which  ranges  from  zero  to  one,  where  zero 
represents  no  skill  and  one  represents  total  accuracy)  was  calculated  for  each  tree  using  the 
dependent  data  set.  The  tree  with  the  best  Heidke  skill  score  was  also  verified  using  the 
independent  data  set.  As  a  further  measure  of  the  final  decision  tree’s  skill,  it  was  compared  with 
the  skills  of  the  Misawa  snow  forecast.  Cook’s  method,  and  persistence. 
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4.  RESULTS. 


4.1  Verification  Of  Decision  Trees.  More  than  60  decision  trees  were  developed  and  tested 
using  different  combinations  of  the  basic  variables.  All  were  verified  against  all  observations  in 
the  POR  from  23  October  1989  to  16  March  1990  (dependent  data  set)  using  standard 
verification  matrices.  Figure  7  shows  the  verification  matrix  used  with  the  best  Misawa  decision 
tree  as  the  example.  The  numbers  in  the  matrix  represent  the  number  of  observations  where 
snow  did  not  occur  (no)  and  did  occur  (yes)  on  the  abscissa,  against  whether  the  tree  did  not 
forecast  snow  (no)  or  did  forecast  snow  (yes)  on  the  ordinate.  The  numbers  outside  the  matrix 
are  row  and  column  totals.  The  matrix  shows  that  there  were  268  observations  of  no-snow  when 
the  tree  forecast  none  (hits),  and  80  observations  of  no-snow  when  the  tree  did  forecast  snow 
(false  alarms).  Similarly,  there  were  32  observations  of  snow  when  the  tree  forecast  no  snow 
(misses),  and  194  observations  of  snow  when  the  tree  forecast  snow  (hits).  A  chi  square  test 
indicated  that  this  distribution  was  significantly  different  from  random  chance  (at  the  0.005 
level).  Also  shown  in  Figure  7  are  the  equations  and  calculations  for  the  Heidke  skill  score, 
probability  of  detection,  and  false  alarm  rate.  The  best  decision  tree  Heidke  skill  score  of  0.63 
was  quite  good.  It  also  had  a  high  probability  of  detection  (0.86)  for  the  occurrence  of  snow  and 
a  low  false  alarm  rate  (0.29). 


OBSERVED  6-HOUR  SNOWFALL 


NO 

YES 

TOTAL 

BEST  MISAWA 
DECISION  TREE 

NO 

268  (A) 

32 

300  (Rl) 

FORECAST 

YES 

80 

194  (8) 

274 (R2) 

TOTAL 

348  (Cl) 

226  (C2) 

374  (T) 

Heidke  Skill  Score  =  (F-D)/(T-D) 

where  F  =  A+B  and  D  -  (Cl  R 1  +  C2R2)/T 
Best  Misawa  tree  score  =  0.63 
Probability  of  Detection  =  B/C2  =  0.86 
False  Alarm  Rate  =  (R2  -  B)/R2  =  0.29 


Figure  7.  Verification  Matrix  and  Heidke  Skill  Score  Calculation  for  the  Best  Misawa 
Snow  Forecast  Decision  Tree. 
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4.1.1  As  an  independent  test  of  the  best  Misawa  snow  forecasting  decision  tree,  the  tree  was 
verified  using  observations  from  1  i  Jan  89  to  27  Feb  89.  Verification  results  for  the  best  Misawa 
decision  tree  are  shown  below.  Although  a  lower  score  is  expected  from  independent 
verification,  the  drop  in  skill  to  0.24  indicates  the  importance  of  a  longer  POR  for  forecast  study 
development.  The  small  number  of  observations  in  the  independent  data  set  may  have 
exaggerated  this  problem. 


VARIABLES*  AND  THRESHOLD  VALUES 

ORAPTEMP  TEMP850  TEMP700  THKNS1  THKNS2  THKNS3  THKNS4  THKNS5  ORWNPPIR  GRWNDSPP 

5-1  5-6  5-12  55300  52790  51280  54020  <1510  210-350  >7 

HEIPKE  SKILL  SCORE 
Dependant  Independent 
Pete  Set  Pete  Set 

0.63  0.24 

*Varial)le  definitions  and  units  of  measure: 

GRADTEMP  -  Gradient-level  temperature  over  Misawa  ("C). 

TEM 1*850  -  Temperature  at  850  mb  over  Misawa  (°C). 

TEMP700  -  Temperature  al  700  mb  over  Misawa  (°C). 

THKNS I  -  Thickness  1 ,000  ft  AGL  (above  ground  level)-500  mb  over  Misawa  (gcopoieniial  meters). 

THKNS2  -  Thickness  1 .000  ft  AGL-750  mb  over  Misawa  (gcopoicnlial  meters). 

THKNS3  -  Thickness  1,000  ft  AGL-850  mb  over  Misawa  (geopotential  meters). 

THKNS4  -  Thickness  850-500  mb  over  Misawa  (gcopotential  meters). 

THKNS5  -  Thickness  850-700  mb  over  Misawa  (geopotcnlial  meters). 

GRWNDUIR  -  Gradient  wind  direction  over  Misawa  (degrees). 

GRWNDSPD  -  Gradient  wind  speed  over  Misawa  (knots). 


Figure  8.  Dependent  and  Independent  Verification  of  Best  Misawa  Snow  Forecast  Decision 
Tree. 


4.1.2  Following  the  same  procedure  used  in  verifying  the  decision  tree,  Heidke  skill  scores  were 
calculated  for  the  actual  6-hour  snowfall  forecasts  issued  by  Misawa,  6-hour  snowfall  estimates 
obtained  from  Cook’s  method,  and  persistence.  The  data  was  sorted  according  to  snow  (yes)  and 
no-snow  (no).  Persistence  was  considered  a  "yes"  if  an  observed  6-hour  snowfall  of  trace  or 
more  was  followed  by  another,  or  if  an  observation  of  no  snowfall  was  followed  by  another  of  no 
snowfall.  Otherwise,  persistence  was  considered  a  "no."  The  Heidke  skill  scores  were  then 
compared  to  those  for  the  decision  tree.  Based  on  the  dependent  data  set,  persistence  scored  best 
at  0.66.  The  Misawa  forecast  skill  and  the  decision  tree’s  skill  were  about  the  same  (0.60  and 
0.63,  respectively).  Cook’s  method  had  a  very  low  0.01  score.  In  the  independent  data  set  test, 
persistence  again  scored  best  at  0.67.  The  Misawa  forecast  skill  was  0.49;  the  decision  tree’s, 
0.24.  Cook’s  method  scored  low  at  0.1 1.  Based  on  these  limited  test  results,  persistence  showed 
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more  skill  at  predicting  snow  occurrence  than  the  Misawa  forecasters,  the  decision  tree,  and 
Cook's  method,  which  had  very  poor  skill.  While  the  decision  tree  scored  about  the  same  as  the 
Misawa  forecast  in  the  dependent  data  set  test,  its  lower  score  in  the  independent  data  set  test  can 
be  attributed  not  only  to  the  small  number  of  observations  but  to  forecaster  experience  at 
Misawa. 

4.2  Implications  for  Misawa.  Although  the  correlations  of  basic,  time-phased,  and  trend 
variables  with  observed  6-hour  snowfall  amounts  were  low,  and  although  linear  regression  on  the 
basic  and  time-phased  variables  to  develop  a  predictive  equation  for  6-hour  snowfall  amounts 
was  unsuccessful,  the  snow  forecasting  decision  tree  (Figure  4)  shows  promise  as  a  guide  for 
snow  forecasting  at  Misawa.  With  a  modest  rate  of  misses  and  false  alarms,  it  should  prove 
useful  in  recognizing  situations  conducive  to  snow. 
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5.  SUMMARY. 


5.1  The  Basic  Study.  The  purpose  of  this  study,  for  Misawa  Air  Base,  Japan,  was  to  develop 
a  predictive  equation  for  6-hour  snowfall  amount  based  on  observed  6-hour  snowfall  and 
model-derived  variables  for  PORs  from  11  January  1989  to  27  February  1989  and  from  23 
October  1989  to  16  March  1990.  USAFETAC  performed  simple  correlations  of  forecasted 
variables  with  observed  snowfall.  Despite  the  low  correlation  coefficients  obtained,  linear 
regression  was  attempted.  Both  single  and  multiple  regression  equations  generated  from  the  best 
combinations  of  variables  gave  unrealistically  low  6-hour  snowfall  estimates.  The  poor 
regression  results  may  be  attributed  in  part  to  the  short  POR,  lack  of  upper-level  moisture  and 
wind  variables,  and  nonlinear  relationships  between  the  variables  and  snowfall  amount. 

5.2  The  Expanded  study.  USAFETAC  took  the  basic  request  a  step  further  by  developing  a 
snow  forecasting  decision  tree  for  Misawa  based  on  the  1 1  basic  variables.  Threshold  values  of 
the  basic  variables  were  determined  by  comparing  their  95th  percentile  values  for  snow  cases 
with  their  50th  percentile  values  for  no-snow  cases.  If  the  95th  percentile  values  for  snow  cases 
were  less  than  the  50th  percentile  values  for  no-snow  cases,  they  were  selected  as  threshold 
values  for  inclusion  in  the  decision  tree.  The  gradient-level  dew  point  temperature  did  not 
qualify  for  inclusion.  For  the  gradient  wind  direction  and  speed,  it  was  most  beneficial  to 
experimentally  obtain  a  preferred  gradient  wind  direction  range  for  snow,  along  with  a  minimum 
speed,  for  inclusion  in  the  trees.  The  best  decision  tree,  which  included  all  basic  variables  except 
gradient-level  de  v  point  temperature,  had  a  Heidke  skill  score  of  0.63  with  the  dependent  data 
set  (23  October  1989  to  16  March  1990),  and  a  score  of  0.24  with  the  independent  data  set  (1 1 
January  1989  to  27  February  1989).  The  score  of  0.63  is  considered  good. 

5.3  Skill  Comparisons.  The  decision  tree  skill  was  tested  further  by  comparing  its  skill  to 
Misawa’s  snow  forecasting  skill,  Cook’s  (1980)  method  of  estimating  snowfall  amount,  and 
persistence.  Results  showed  that  persistence  scored  best  in  both  the  dependent  and  independent 
data  set  tests.  Cook’s  method  scored  poorly  in  both  tests.  The  Misawa  snow  forecasting  skill 
was  about  the  same  as  the  decision  tree’s  in  the  dependent  data  set  test,  but  it  outseored  the 
decision  tree  in  the  independent  data  set  test. 

5.*»  RecommendatL'ns.  USAFETAC  does  not  recommend  use  of  either  the  regression 
technique  or  the  decision  tree  in  operational  forecasting.  The  decision  tree  should,  however,  be 
evaluated  for  usefulness  as  a  guide  in  determining  the  likelihood  of  snow  at  Misawa.  As  more 
data  is  collected,  the  thresholds  used  in  the  decision  tree  can  be  adjusted  in  an  effort  to  improve 
its  performance. 
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GLOSSARY 


AFGWC 

AGL 

GRADDEWT 

CRADDEW 

GRADTEMP 

GRADTEM 

GRDDDIFF 

GRDTDIFF 

GRWNDDIR 

GRWNDSPD 

GWNDDIR 

GWNDSPD 

R2 

TEMP7(X) 

TEMP70_ 

TEMP850 

TEMPF.5 


Air  Force  Global  Weather  Central  (Offutt  AFB,  Nebraska) 
Above  ground  level 

Gradient-level  dew-point  temperature  over  Misawa 

Same  as  GRADDEWT,  except  valid  6  hours  prior  to  snowfall 
measurement 

Gradient-level  temperature  over  Misawa 

Same  as  GRaDTEMP,  except  valid  6  hours  prior  to  snowfall 
measurement 

Change  in  GRADDEWT  during  the  6  hours  prior  to  snowfall 
measurement 

Change  in  GRADTEMP  during  the  6  hours  prior  to  snowfall 
measurement 

Gradient  wind  direction  over  Misawa 
Gradient  wind  speed  over  Misawa 

Same  as  GRWNDDIR,  except  valid  6  hours  prior  to  snowfall 
measurement 

Same  as  GRWNDSPD,  except  valid  6  hours  prior  to  sncwfall 
measurement 

Coefficient  of  determination 

Temperature  at  7(X)  mb  over  Misawa 

Same  as  TEMP700,  except  valid  6  hours  prior  to  snowfall 
measurement 

Temperature  at  850  mb  over  Misawa 

Same  as  TEMP850,  except  valid  6  hour  prior  to  snowfall 
measurement 


>6 


THKNS1 


Thickness  from  1  ,(XK)  ft  AGL  to  5(X)  mb  over  Misawa 


THKNS  l_ 

Same  as  THKNS I,  except  valid  6  hours  prior  to  snowfall 
measurement 

THKNS2 

Thickness  from  1,(XX)  ft  AGL  to  7(H)  mb  over  Misawa 

THKNS2_ 

Same  as  THKNS2,  except  valid  6  hours  prior  to  snowfall 
measurement 

THKNS3 

Thickness  from  1,(X)0  ft  AGL  to  850  mb  over  Misawa 

THKNS 3 

Same  as  THKNS3  except  valid  6  hours  prior  to  snowfall 
measurement 

THKNS4 

Thickness  from  850  mb  to  500  mb  over  Misawa 

THKNS4 

Same  as  THKNS4,  except  valid  6  hours  prior  to  snowfall 
measurement 

THKNS5 

Thickness  from  850  mb  to  700  mb  over  Misawa 

THKNS5 

Same  as  THKNS5,  except  valid  fi  hours  prior  to  snowfall 
measurement 

T700D1FF 

Change  in  TEMP700  during  the  6  hours  prior  to  snowfall 
measurement 

T850D1FF 

Change  in  TEMP850  during  the  6  hours  prior  to  snowfall 
measurement 

THK1DIFF 

Change  in  THKNS  1  during  the  6  hours  prior  to  snowfall 
measurement 

THK2D1FF 

Change  in  THKNS2  during  the  6  hours  prior  to  snowfall 
measurement 

THK3D1FF 

Change  in  THKNS3  during  the  6  hours  prior  to  snowfall 
measurement 

THK4DIFF 

Change  in  THKNS4  during  the  6  hours  prior  to  snowfall 
measurement 
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THK5DUFF 

USAFETAC 

WDIRDfFF 

WSPDDIFF 

Z 


Change  in  THKNS5  during  the  6  hours  prior  to  snowfall 
measurement 

USAF  Environmental  Technical  Applications  Center 

Change  in  GRWNDD1R  during  the  6  hours  prior  to  snowfall 
measurement 

Change  in  GRWNDSPD  during  the  6  hours  prior  to  snowfall 
measurement 

Zulu  (Greenwich  Mean  Time) 
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OL-K,  HQ  AWS,  NEXRAD  Opn!  Support  Facility,  1200  Westhcimer  Dr.  Norman,  OK  73069 . .  1 

OL-M,  HQ  AWS,  McClellan  AFB,  CA  95652-5609 . 1 

Del  1,  HQ  AWS,  Pentagon,  Washington,  DC  20330-6560 . . . 3 

Dei  2,  HQ  AWS,  Pentagon,  Washington,  DC  20330-5054 . 3 

Del  3.  HQ  AWS,  PO  Box  3430,  Onizufca  AFB,  CA  94088-3430 . 1 

Del  9,  HQ  AWS,  PO  Box  12297,  Las  Vegas,  N  V  89 1 12-0297 . 1 

1WW/DN,  Hie  team  AFB,  HI  96853-5000 . 3 

1  IWSflDON,  Elnsendorf  AFB,  AK  99506-5000 . . . 1 

20WS/DON,  APO  San  Francisco  96328-5000 . 1 

30WS/DON,  APO  San  Francisco  96301  -0420 . 1 

2WW/DN,  APO  New  York  09094-5000 . . . 3 

7WS/DON,  APO  New  York  09403-5000 . I 

28WS/DON,  APO  New  York  09127-5000 . 1 

3IWS/DON,  APO  New  York  09136-5000 . . . ! 

3WW/DN,  OfluU  AFB.  NE  681 13-5000 . 6 

9WS/DON,  March  AFB,  CA  925 18-5000 . i 

24WS/DON,  Randolph  AFB.  TX  78 150-5000 . t 

26WS/DON,  Barksdale  AFB.  LA  7 1 1 10-5002 . 1 2 

4WW/DN,  Peterson  AFB,  CO  80014-5000 . 3 

2WS/DON,  Andrews  AFB.  MD  20334-5000 . 20 

5WW/DN.  Langley  AFB,  V A  23665-5000 . 3 

1 WS/DON,  Mac  Dill  AFB.  FL  33608-5000 . ! 

3WS/DON,  Shaw  AFB,  SC  291 52-5000 . 1 

5WS/DGN,  Ft  McPherson,  G A  30330-5000 . 1 

25WS/DON,  Bergstrom  AFB.  TX  78743-5000 . i 

AFGWOSDSL,  OffuU  AFB,  NE  681 13-5<XX) . 3 

USAFETAC,  Seem  AFB,  IL  62225-5438 . 6 

7W  W/DN,  Scott  AFB,  IL  62225-5(X)8 . 3 

6WS/DON,  Hurl  hurt  Field,  FL  32544-5000 . I 

15WS/DON,  McGuire  AFB,  NJ  0864 1  -5002 . I 

17WS/DON,  Travis  AFB,  CA  94535-5986 . I 

3350  TCHTG/TTGU-W,  Stop  62,  Chanutc  AFB,  IL  61868-50W . 2 

3395  TCHTG/TTKO-W.  Keeslcr  AFB,  MS  39534-5<XX) . 2 

AFIT/CIR,  Wrighl-Patlcrson  AFB,  OH  45433-6583 . ! 

AFCSA/SAGW,  Washington.  DC  20330-5«» . 1 

N A VOCEANO  (Rusty  Russian),  Slcnnis  Space  Ctr,  MS  3951 1-5CXJ1 . 2 

NAVOCEANCOMDET,  Federal  Building,  Asheville,  NC  28801-2723 . I 

NAVOCEANCOMDET,  Patuxent  River  NAS,  MD  20670-5 103 . I 

NAVOCEANCOMFAC,  NAS  North  Island,  San  Diego,  CA  92135-5130 . 1 

COMNAVOCEANCOM,  Code  N3I2,  Stcnnis  Space  Ctr,  MS  39529-5IXX) . 1 

COMNAVOCEANCOM  (Capt  Brown,  Code  N332),  Stcnnis  Space  Ctr,  MS  39529-5001 . 1 

NA VOCEANO.  Code  9220  (Tony  Ortolanol.Slcnnis  Space  C’ u,  MS  39529-5 (XI! . I 

Maury  Oceanographic  Library  (NOC),  Code  XJL,  Stcnnis  Space  Or,  MS  39529-5001 . . I 

FLENUMOCEANCEN,  Monterey,  CA  93943-5006 . 1 

NOARL  West,  Monterey.  CA  93943-5006 . I 

Naval  Research  Laboratory,  Code  4323,  Washington,  DC  20375 . . 1 
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Naval  Postgraduate  School,  Chmn,  Dept  of  Meteorology,  Code  63,  Monterey,  CA  93943-5000 . . . . . 1 

Naval  Eastern  QceanogrsqAy  Ctr,  U1  17  MeCAdy  Bldg,  NAS  Norfolk,  Norfolk,  VA  2351 1-5000 . 1 

Nava!  Western  Oceanography  Ctr,  Box  1 1 3,  Attn:  Tech  Library,  Pearl  Harbor,  Hi  96860-5000 . 1 

Naval  Oceanography  Command  Cir,  COMNAVMAR  Box  12,  FPO  San  Francisco,  CA  96630-5000 . 1 

Pacific  Missile  Test  Center,  Geophysics  Division,  Code  3253,  Pi  Mugu,  CA  93042-5009 . 1 

Dc)4<tf'('onmKWC/NOAA/MAS(\  library  MC5  (Jean  Bankhead),  325  Broadway,  BtntWer. ('()  8030  3 . } 

OFCM,  Suite  900, 6010  Executive  Blvd,  Rockville,  MD  20852 . . . I 

NOAA  Library-EOC4WSC4,  Attn:  ACQ,  6009  Executive  Blvd.  Rockville  MD  20852 . 1 

NOAA/NESDIS  (Attn:  Nancy  Everson,  E/RA22),  World  Weather  Bklg,  Rm  703,  Washington,  DC  20233 . 1 

NOAA/NESDJS  (Attn:  Capt  Taylor),  FB  #4,  Rm  0308,  Suilland,  MD  20746 . 1 

Armed  Races  Medical  Intelligence  Agency,  Info  Sves  Div.,  Bldg  1607,  Ft  Detrick,  Frederick,  MD  21701  -5004 . 1 

GL/LY, Hanscoro  AFB,  MAO  1731 -5000 . . . 1 

GL  Library,  Attn:  SULLR,  Slop  29,  Hanscom  AFB,  MA  01731-5000 . .. . . . . . 1 

Atmospheric  Sciences  Laboratory,  Aun:  SLCAS-AT-AB,  Aberdeen  Proving  Grounds,  MD  21005-5001 . 1 

Atmospheric  Sciences  Laboratory,  Aun:  SLCAS-AS-I,  White  Sands  Missile  Range,  NM  88002-5501 . . . 1 

Army  Missile  Command,  ATTN:  AMSM1-RD-TE-F,  Redstone  Arsenal,  AL  35898-5250 . 1 

Army  Missile  Command,  ATTN:  AMST-TC-AM  (RE),  TCOM  Met  Team,  Redstone  Arsenal,  AL  35898-8052 . 1 

Commander  and  Director.  U.S.  Army  CEETL,  Aun:  GL-AE,  Rm  Bclvoir,  VA  22060-5546 . 1 

Technical  Library,  Dugway  Proving  Ground.  Dugway,  UT  84022-5000 . . . . . 1 

NWS  W/OSD,  Bldg  SSM  C-2  East- West  Hwy,  Silver  Spring,  MD  20910 . I 

NWS  Training  Center,  617  Hardesty,  Kansas  City,  MO  64 124 . 1 

NCDC  Library  (D542X2),  Federal  Building,  Asheville,  NC  28801-2723 . 1 

NIST  Pubs  Production,  Rm  A-405,  Admin  Bklg,  Gaithersburg,  MD  20899 . I 

JSOCTWcather,  P.O.  Box  70239,  Fort  Bragg.  NC  28307-5000 . 1 

75th  RGR  ((Aun:  SWO),  Ft  Benning  GA  31905-5000 . i 

HQ  5th  U.S.  Army,  AFKB-OP  (SWO),  Ft  Sam  Houston,  TX  78234-7000 . 1 


DT1C-FDAC,  Cameron  Station,  Alexandria,  VA  22304-6145  . 2 

AUL/LSE,  Maxwell  AFB,  AL  36!  12-5564 . 1 

AWSTL,  Seou  AFB,  IL  62225-5438 . . . 35 
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